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Question 2 


Intent of Question 


The primary goals of this question were to assess a student’s ability to (1) calculate the sample size when given 
the endpoints of a confidence interval for a proportion; (2) explain how bias could be present in a particular 
survey method; and (3) estimate a proportion from sample data collected using a method designed to decrease 
bias. 


Solution 
Part (a): 


Using the standard formula for a confidence interval for one proportion, the interval (0.584 to 0.816) is found 


as follows. p + zt PE P) where p = eee ee = 0.7, the margin of error is 0.816 — 0.7 = 0.116, and 
nN 
z* = 1.96. 


2 
Solving ie = 0.116 yields n = et ~ 59.95. The sample size was 60. 
n (0.116) 


Part (b): 


Bias might have been introduced because students responded directly to the environmental science teacher. 
Because the students would know that an environmental science teacher cares about the environment, they 

might say yes when they actually don’t recycle. This would result in a point estimate that is greater than the 
proportion of all students who would respond yes to the question. 


Part (c): 
(1) The expected number is (300)(3] = 150. 


(11) The point estimate 1s based on expecting 150 students to be required to say no and 150 students to 
truthfully answer the question. Of the 213 answers of no, we expect that 213 — 150 = 63 were from 
students who truthfully answered the question. That means we expect that the remaining 150 — 63 = 87 
students truthfully answered the question and responded yes. So the point estimate for the proportion of 


all students at the high school who would respond yes to the question is — = 0.58. 
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Question 2 (continued) 


Parts (a), (b), and (c) are scored as essentially correct (E), partially correct (P), or incorrect (I). 


Part (a) is scored as follows: 


Essentially correct (E) if the response satisfies the following five components: 


I. 


ae 


where p is between 0 and 1. 


Uses a standard error in the form ,J2*+—* (.- p) 
nN 





Shows evidence that p = 0.7 was correctly used in the standard error. 





Shows evidence that 0.116 was correctly used as the margin of error in the calculation. 
Shows evidence that z* = 1.96 was correctly used as the critical value in the calculation. 
Includes a single, positive whole-number answer. 





Partially correct (P) if the response satisfies only three or four of the five components. 


Incorrect (I) if the response satisfies at most two of the five components. 


Notes: 


De ; 
z pU- p) 
MOE” 

A value of 0.21 in the numerator of the standard error implies that p = 0.7 was correctly used in the 


Using an equation in the form n = satisfies component 1. 


standard error and satisfies component 2. 

An equation such as 0.816 = 0.7 + MOE implies that 0.116 was correctly used for the margin of error 
and satisfies component 3. 

Statements that suggest a whole-number answer is approximate (such as, “about 60” or “=~ 60’) satisfy 
component 5. 

Algebraic work between the set-up and final answer does not need to be shown to satisfy component 5. 
When calculating the values 0.7, 0.116, or 1.96, ignore minor arithmetic errors or transcription errors if 
they can be identified by the work shown. 
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Question 2 (continued) 
Part (b) is scored as follows: 


Essentially correct (E) if the response satisfies the following three components: 

1. Explains why the responses to the survey might differ from the truth about student recycling in this 
context (for example, the survey was not anonymous, the question was asked by an authority figure). 

2. Explains how the responses to the survey might differ from the truth about student recycling (for 
example, “students might say yes when they actually don’t recycle,” “students lie and say yes,” “ 
don’t recycle but lie to the teacher’). 

3. Describes the effect of the bias on the point estimate (or the proportion, percentage, number of yes 
responses in the sample) and doesn’t contradict the bias described. 


99 66 


students 


Partially correct (P) if the response satisfies only two of the three components. 
Incorrect (1) if the response satisfies at most one of the three components. 


Notes: 

e To satisfy component | the response must provide a reason that 1s based on a bias created by the teacher 
asking students in person. For example, a response that addresses the wording of the question, voluntary 
response, or sampling variability does not satisfy component 1. 

e To satisfy component 2 the response needs to explicitly contrast what the students say with what they do. 

e Evidence used to address component 3 cannot also be used to address component 2. For example, a 
response that says “Students might lie, producing an estimate that is too high” addresses the effect of the 
bias on the point estimate but should not be combined with the statement about students lying to infer that 
students do not actually recycle. However, a response that says “Students may lie and say yes, producing 
an estimate that is too high” satisfies both components 2 and 3. 

e Ifthe response is clearly about the population proportion and not about the point estimate, component 3 
cannot be satisfied. 

e Statements such as “the interval will be too high” do not satisfy component 3 because they don’t 
specifically address the point estimate. 
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Question 2 (continued) 
Part (c) is scored as follows: 


Essentially correct (E) if the response gives an answer of 150 in (c-1) and gives an answer of 0.58 (or equivalent) 
in (c-11). 


Partially correct (P) if the response gives an answer of 150 in (c-1) and gives an answer of 0.42 (or equivalent) 
in (c-11); 
OR 
if the response does not give an answer of 150 in (c-1) but gives an answer of 0.58 (or equivalent) with supporting 
work in (C-11). 


Incorrect (I) if the response does not meet the criteria for E or P. 


Notes: 

e In part (c-1) the answer must be a single number. Responses such as “at least 150” or “147-153” are 
incorrect. However, responses such as “about 150” or “= 150” are acceptable. 

e In part (c-11) the proportion can be described verbally (e.g., “87 out of 150”). 

e In part (c-11) if the response clearly indicates that 0.58 (or 0.42) is the population proportion, lower the 
overall score in part (c) by one level (that is, from E to P, or from P to I). Using probability notation such 
as P(yes) does not clearly indicate a population proportion. 

e In part (c-11) if the response includes a point estimate of 0.58 or 0.42 but uses a confidence interval as the 
final answer, lower the overall score in part (c) by one level (that is, from E to P, or from P to I). 

e Ifthe answer is incorrect in part (c-1) and the answer in part (c-11) uses numerator = 87 and 
denominator = 300 — answer to (c-1), the response should be scored P. 
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Question 2 (continued) 


Complete Response 

Three parts essentially correct 
Substantial Response 

Two parts essentially correct and one part partially correct 
Developing Response 

Two parts essentially correct and no parts partially correct 
OR 

One part essentially correct and one or two parts partially correct 
OR 

Three parts partially correct 
Minimal Response 

One part essentially correct 


OR 
No parts essentially correct and one or two parts partially correct 
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2. An environmental science teacher at a high school with a large population of students wanted to estimate the 
proportion of students at the school who regularly recycle plastic bottles. The teacher selected a random sample 
of students at the school to survey. Each selected student went into the teacher’s office, one at a time, aad was 


asked to respond yes or no to the following question. 


Do you regularly recycle plastic bottles? 


Based on the responses, a 95 percent confidence interval for the proportion of ali students at the school who 
would respond yes to the question was calculated as (0.584, 0.816). 


(a) How many students were in the sample selected by the environmental science teacher? 
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(b) Given the method used by the environmental] science teacher to collect the responses, explain how bias 
might have been introduced and describe how the bias might affect the point estimate of the proportion of all 


students at the school who would respond yes to the question. 
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(c) The statistics teacher at the high school was concerned about the potential bias in the survey. To obtain a 
potentially less biased estimate of the proportion, the statistucs teacher used an alternate method for 
collecting student responses. A random sample of 300 students was selected, and each student was given the 
following instructions on how to respond to the question. 


@ In private, flip a fair coin. 
e If heads, you must respond no, regardless of whether you regularly recycle. 
e If tails, please truthfully respond yes or no. 


(i) What is the expected number of students from the sample of 300 who would be required to respond no 
because the coin flip resulted in heads? 


200 (=) = 150 
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(1i) The results of the sample showed that 213 of the 300 selected students responded no. Based on the 


results of the sample, give a point estimate for the proportion of all students at the high school who 
would respond yes to the question. 
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2. An environmental science teacher at a high school with a large population of students wanted to estimate the 
<Bfoportion 6 students at the school who regularly recycle plastic bottles. The teacher selected a random sample 
Of students at the school to survey. Each selected student went into the teacher’s office, one at atimre;and was 
asked to respond yes or no to the following question. 


| Do you regularly recycle plastic bottles? | 


Based on the responses, a@5 percent confidence interval for the roportion of all students at the school who 
would respond yes to the question was calculated a0. 84, 0.816 


(a) How many students were in the sample selected by the environmental science teacher? 
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(b) Given the method used by the environmental science teacher to collect the responses, ne how 


might have been introduced and describe how the bias might affect the pomt estimate of the proporau of all 
students at the school who would respond yes to the question. 
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(c) The statistics teacher at the high school was concemed about the potential bias in the survey. To obtain a 
potentially less biased estimate of the proporsion, the statistics teacher used an alternate method for 


collecting student responses. A random sample o 300 2 dents was selected, and each student was given the 
following instructions on how to respond to the que 









e In private, flip a fair coin. 


e If heads, you must respond no, regardless of whether you regularly recycle. 


e If tails, please truthfully respond yes or no. 


(i) What is the expected number of students from the sample af300 who would be required to respond no 
because the coin flip resulted in heads? C7 
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(11) The results of the sample showed thaf213 bf 300 selected students responded no.)Based on the 
results of the sample, give a point estimate for thé proportion of all students at the Migh school who 
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2. An environmental science teacher at a high schoo] with a large population of students wanted to estimate the 
proportion of students at the school who regularly recycle plastic bottles. The teacher selected a random sample 
of students at the school to survey. Each selected student went into the teacher’s office, one at atime, and was 


asked to respond yes or no to the following question. 


| Do you regularly recycle plastic bottles? | 


Based on the responses, a 95 percent confidence interval for the proportion of ail students at the school who 
would respond yes to the question was calculated as (0.584, 0.816). 


(a) How many students were in the sample selected by the environmental science teacher? 
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(b) Given the method used by the environmental science teacher to collect the responses, explain how bias 
might have been inwoduced and describe how the bias might affect the point estimate of the proportion of all 
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(c) The statistics teacher at the high school was concerned about the potential bias in the survey. To obtain a 
potentially less biased estimate ofthe proportion, the statistics teacher used an alternate method for 
Collecting student responses. A random sample of 300 students was selected, and each student was given the 
following instructions on how to respond to the question. 


e In private, flip a fair coin. 
e If heads, you must respond no, regardless of whether you regularly recycle. 


e If tails, please truthfully respond yes or no. 


(iy What is the expected number of students from the sample of 300 who wanild be requited to respond no 
because the coin flip resulted in heads? 


300 (0-8) = ((60 stushonts 





(ii) The results of the sample showed that 213 of the 300 selected students responded no. Based on the 


results of the sample, give a point estimate for the proportion of all students at the high school who 
would respond yes to the question. 


(2-912) - 324 
AUD 
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Question 2 


Overview 


The primary goals of this question were to assess a student’s ability to (1) calculate the sample size when given 
the endpoints of a confidence interval for a proportion; (2) explain how bias could be present in a particular 
survey method; and (3) estimate a proportion from sample data collected using a method designed to decrease 
bias. 


Sample: 2A 
Score: 4 


In part (a) the response includes the formula et for the standard error, satisfying component |. Because the 


difference between a point estimate and population proportion is assessed in parts (b) and (c), using p and g instead 


i bcd | 0.7)(0.3 
of p and g inthe formula was considered a minor error. In the equation 0.116 = 1.96 Po the response 


correctly uses p = 0.7 in the standard error, which satisfies component 2, correctly uses 0.116 as the margin of 


error, which satisfies component 3, and correctly uses 1.96 as the critical value, which satisfies component 4. 
Finally, the response includes a single, positive whole-number answer (60), satisfying component 5. Because the 
response includes all five components, part (a) was scored as essentially correct. In part (b) the response provides a 
reason why the survey responses might be different from the truth (“Due to the pressure to answer a certain way’’), 
satisfying component 1. The response explains how the survey responses differ from the truth (“more likely to 
respond yes to the question, even if that was not their true answer’), satisfying component 2. Finally, the response 
describes the effect of the bias on the point estimate (“causing the point estimate to be too high’), satisfying 
component 3. Because the response includes all three components, part (b) was scored as essentially correct. In 
part (c-1) the response gives an answer of 150. In part (c-11) the response provides an answer of 0.58. Because the 
response includes both correct answers, part (c) was scored as essentially correct. Because three parts were scored 
as essentially correct, the response earned a score of 4. 


Sample: 2B 
Score: 3 


7(3) 


In part (a) the response includes the equation 0.116 = 1.96,;-—-—, which uses a standard error in the correct form, 
n 


satisfying component 1. In the same equation, the response also correctly uses p = 0.7 in the standard error, which 


satisfies component 2, correctly uses 0.116 as the margin of error, which satisfies component 3, and correctly uses 
1.96 as the critical value, satisfying component 4. Finally, the response includes a single, positive whole-number 
answer (60), satisfying component 5. Because the response includes all five components, part (a) was scored as 
essentially correct. In part (b) the response provides a reason why the survey responses might be different than the 
truth (“the students might feel pressure to answer yes’’), satisfying component |. While the response indicates that 
the students are likely to say yes (“pressure to answer yes’’), the response does not indicate that the students do not 
actually recycle. Because the response does not describe how the survey responses would differ from the truth, 
component 2 is not satisfied. Finally, the response describes the effect of the bias on the point estimate (“the point- 
estimate might overestimate the true proportion of all students who recycle plastic bottles’), satisfying component 3. 
Because the response includes two of the three components, part (b) was scored as partially correct. In part (c-1) the 
response gives an answer of 150. In part (c-11) the response provides an answer of 0.58. Because the response 
includes both correct answers, part (c) was scored as essentially correct. Because two parts were scored as 
essentially correct, and one part was scored as partially correct, the response earned a score of 3. 
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Question 2 (continued) 


Sample: 2C 
Score: 2 


In part (a), the response includes the formula 0.584 = 0.7 — 1.96 OD which uses a standard error in the 


correct form, satisfying component 1. In the same equation, the response also correctly uses p = 0.7 in the standard 


error, which satisfies component 2, and correctly uses 1.96 as the critical value, which satisfies component 4. 
Furthermore, the equation implies that 0.116 was correctly used for the margin of error (described in the third 
scoring note of the scoring guidelines), satisfying component 3. Finally, the response includes a single, positive 
whole-number answer (60), satisfying component 5. Because the response includes all five components, part (a) was 
scored as essentially correct. In part (b) the response provides a reason why the survey responses might be different 
from the truth (“Since the teacher asking the question is an environmental science teacher’), satisfying component 1. 
The response explains how the survey responses differ from the truth (“show that they recycle regularly when in 
reality they might not’), satisfying component 2. Finally, the response describes the effect of the bias on the point 
estimate (“the point estimate of the proportion may be higher than it actually is’), satisfying component 3. Because 
the response includes all three components, part (b) was scored as essentially correct. In part (c-1) the response gives 
an answer of 150. In part (c-11) the response provides an answer of 0.29, which is the overall proportion of “yes” 
responses in the sample. Because the response 1n part (c-11) does not account for the 150 students who would be 
expected to say “no” because of the coin flip, the response was scored as incorrect. Because two parts were scored 
as essentially correct, and one part was scored as incorrect, the response earned a score of 2. 
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